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(57) ABSTRACT 

A web page has a player for playing media objects, a 
sequencer which displays a play list that defines an order in 
which media objects are played by the player, and a media 
access area for containing a plurality of graphical icons. 
Each graphical icon representing a media object, and the 
graphical icons can be manipulated by a user to modify the 
play list. For example, the media icons may be draged to the 
sequencer to add them to the sequencer. 

28 Claims, 19 Drawing Sheets 



1^ Media and Tyan»actlon$, Ing 



\\ m Ecu View Go Fawrtas Help || <=»^ <=>^OD^|C^G3 Q <^1B 1^ 




18 



11/28/2003, EAST Version: 1,4.1 



U.S. Patent Sep. 17, 2002 sheet 1 of 19 



US 6,452,609 Bl 



00 




11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. 17, 2002 sheet 2 of 19 



US 6,452,609 



12 



26 



Business 
Entertainment 
• News 
Sports 



FIG..2A 



Topics I People Sites Search 



'24 



Business Entertainment Sports News 



■22 



28 



12 



26 
26 



FIG..2B 



Topics People 


Sites 


^» Business 




• Entertainment 




• News 




o Business 




0 Clinton 




o Crime 




Health 




Human Interest 


0 Live News 




o Nation 




o Politics 




o Technology & Science 


0 World 





>24 



>29 



Sports 



Business Entertainment Sports News 



-22 



■28 



11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. 17, 2002 sheet 3 of 19 US 6,452,609 Bl 



12- 



Topics People 



Sites 



Search 




Business 
Entertainment 
News 
o Business 
o Clinton 
o Crime 
o Health 

o Human Interest 
o Live News 
o Nation 
o Politics 
■ Democrats 



34 



30 



r40 



ore Pushes for IRS Reform ) 
Joe Kennedy Will Not Seek Re-Election' r 
Ci Vote Gore in 2000 ^ 
■ Republicans ^ ' 

o Technology & Science 
o World 
Sports 



'30 



Business 



Entertainment 



Sports "^ews | 



FIG.-2C 



11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. 17, 2002 Sheet 4 of 19 US 6,452,609 Bl 




11/28/2003, EAST Version: 1.4.1 



U.S. Patent 



Sep. 17, 2002 



Sheet 5 of 19 



US 6,452,609 Bl 




"V" 
I 



CO 



is 

CLO 



X 



ca « .§ 
./Sis 

x:Eu.O 



S=5 



o 

* CIS 

<i>5 S-aS 
5= 3 o o a> 

F<OSQ 



AAA 



O 3 O >^ 



CO 



C 
O 

1 

LJJ 

I 

a> 
GC 

Q> 

a> 

CO 



c 
c 

O 




11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. 17, 2002 Sheet 6 of 19 US 6,452,609 Bl 



FIG.-6A ^ 



FIG.-6B < 



72- 



46 



Playl 
MyC 


Delete t> 
Rename ^ 


FdlcKMi^CipG are h Your Player < 


□ Ci 


Go To > 

Solar Eclipse 


s for IRS Reform I> 
w A Rare Spectacle in the Sky \> 



14 



^4 6 
J t 

My Clips I Music y^' 



Play Lists I l> The FollcjwingCfips are in Your Player < 

72 



44 



n Q Warner Brothers: The Soundtrack from the 
" film Midnight In The Garden Of Good & Evil 

n M. Paula Cole: I Don't Want To Wait (Large 
99K) 

B 1^ David Byrne Miss America 



FIG.-6C 



Play Lists I ^ The Following Cips are in Your Player < 

!^ 72>^J22^_^74 



72^ 72-s 




82 



{ liaures 
I t>/ii I fi 



772 yr104 ^106 



Z 



774 



0 



702-^ — ;L, 



705 



FIG.^7< 




16 



11/28/2003, EAST Version: 1.4.1 



U.S. Patent 



Sep. 17, 2002 



Sheet 7 of 19 



US 6,452,609 Bl 



CO 



I 

.9? 
o 



CD 
(0 
O) 

cc 

i 

m 

OQ 

a: 

O 
Q. 

:^ 

o 
o 
PC 

CL 
O 

X 



i 

CO 

cc 

o 
cc 

E 



CO 

■s 

8 

CD 



O 



2 

s 



CO 

t- O 



CA 

c 

a 

c 
o 
o 



CO 
3 



CO 

< 



< ^ 



DQ 5 
CO o 

n 



CO Q CO c 

.«-5 3 2 = 
CO CD m m 



O 3 
OU- 



5§ 



Oddd^DtlCICI tl 



N 




CO 

b 



11/28/2003, EAST Version: 1.4.1 




11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. 17, 2002 sheet 9 of 19 




11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. 17, 2002 sheet 10 of 19 US 6,452,609 Bl 




11/28/2003, EAST Version: 1.4.1 



U.S. Patent 



Sep. 17, 2002 Sheet 11 of 19 



1002 



US 6,452,609 Bl 
1000 



r 



r 



1010 



CONTENT 




^1020 


DATABASE 






^1012 




INTERFACE 




Webserver 
APPLICATION 
SERVER 


DATABASE 




^1014 




USER 
DATABASE 


r 





PAGELESS WEB 
SERVER & BROWSER 
COMPONENTS 



1025 





1004 



FIG.. 10 



11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. n, 2002 sheet 12 of 19 us 6,452,609 Bl 



ON CLIENT LOAD 



1102 

"userWes 

^COOKIE. 

1120 




CREATE 
NEW USER 

IN USER 
DATABASE 



1122 



GET 
NEW USER 
ID 



1124 



WRITE 
COOKIE 

WITH 
USER ID 



1104 



QUERY USER 
DATABASE 



z: 



1106 



LOAD 
SEQUENCER 
DSOw/USER 
TABS AND 
PLAY LISTS 



z: 



1108 



LOAD USER 
SPECIFIC 
SITE 
PRE-LOADS 



z: 



1110 



LOAD SITE 
SPECIFIC 
PRE-LOADS 



z: 



1112 



1114 



GET MICRON 
ACCESS 
TOP TABS 



START 
SPONSOR 
BANNER 
ROTATION 



FIG.^11 



11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. 17, 2002 sheet 13 of 19 



US 6,452,609 Bl 



NAVIGATES OUTLINE, DRAGS MICON 



OUTLINE 



MICON 



1202 



CLOSE 
OUTLINE 

OPEN 
AT SAME 

LEVEL 



1204 



BLINK 
"RETREIVING 
ELEMENr 
IN RED 




z: 



1224 



DRAGGED 
MICON 
DISAPPEARS 



z: 



1206 



GET SQL 
QUERY DATA 
FROM CLIENT 

MEMORY 



1208 



GENERATE 
SQL QUERY 
SEND TO 
SERVER 



1226 



APPEND MICON 
RECORD FROM 
MEMORY TO 
SEQUENCER 

DSO 
APPLY USER 
AND TAB IDS 
TO RECORD 



1210 



RECEIVE 
RECORDSET 
STORE IN 
CLIENT MEMORY 



1228 



UPDATE USER 
DATABASE 

TABS& 
PLAYLISTS 



z: 



1212 



FORMAT WRITE 
OUTLINE LEVEL 

TO SCREEN 
FROM MEMORY 



FIG.. 12 



11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. 17, 2002 sheet 14 of 19 US 6,452,609 Bl 



USER SWITCHES TABS IN SEQUENCER 

1300 



TAB CLICK 



1302 



SEQUENCER DSO 
SUBMIT CHANGES 
IN RECORDSET TO 
USER DATABASE 



z: 



1304 



FILTER DSO 
RECORDSET 
ON NEW TAB ID 



1306 



PLAY LIST 
TABLE BOUND TO 
DSO REWRITES 



z: 



1308 



DATASET CHANGE 
RESETS SOURCE 
FOR THE OBJECT 
PLAYER. OBJECT 
PLAYER READY 
TO PLAY FIRST 
CHECKED OBJECT 



FIG,.13A 



USER CHANGES TABS IN SEQUENCER 

^^^^ ^1352 ^1354 



PLAY LISTS 
MENU SELECT: 

CREATE: tabname 
DELETE: tabname 
RENAME: tabname 




1 r 

FILTER AND 
CHANGE TAB FIELD 
OF SEQUENCER 
DSO RECORDSET 




TAB TABLE 
BOUND TO 
DSO REWRITES 











FIG.. 13B 



11/28/2003, EAST Version: 1.4.1 



U.S. Patent 



Sep. 17, 2002 



Sheet 15 of 19 



US 6,452,609 Bl 



USER NAVIGATES TABS 



USER 
DATABASE 
LOAD TO 
SEQUENCER 
DSO 



USER 
CREATES 

OR 
EDITS TABS 



USER CLICKS 
TAB-LEFT 
BUTTON 



USER CLICKS 
TAB-RIGHT 
BUTTON 



TAB DISPLAY 
MANAGER 



CHECK FOR 
TABS TO THE 
LEFT 




^1352 


SET FIRST TAB = 
FIRST TAB -1 




^1354 



SET LAST TAB TO 
FIRST/LAST TAB 

+1 UNTIL NO 
MORE TABS FIT 
ON AXIS 



CHECK FOR 
TABS TO THE 
RIGHT 




^1362 


SET LAST TAB = 
LAST TAB +1 




^1364 



SET FIRST TAB TO 
LAST/FIRST TAB 

-1 UNTIL NO 
MORE TABS FIT 
ON AXIS 





^135 


6 




^1366 


POSITION 
VISIBLE TABS 


POSITiON 
VISIBLE TABS 



RESET TAB 
UR BUTTONS 



1358 



/ 



1350 



FIG.. 13C 



11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. 17, 2002 Sheet 16 of 19 US 6,452,609 Bl 



USER PLAYS PLAY LIST 



PLAY BUTTON 
CLICKED 






OBJ 
PLA 
BUFt 
STR 


ECT 
YER 
=ERS 
EAM 



1400 



1402 



GET SPONSOR 
URL'S FROM 
SEQUENCER 
DSO FOR PLAYING 
MEDIA OBJECT 



1406 



STOP DEFAULT 
BANNER 
ROTATION 



1404 



1410 



START MEDIA OBJECT 
SPECIFIC ROTATION 

(e.g. SOURCE, 
SPONSOR BANNERS) 



'GET 
MEDIA 
TYPE AND 
IMAGE 
SIZE 

SIZE <= 
DEFAULT 



1412 
SIZE> 
DEFAULT 



z: 



1430 



MEDIA OBJECT 
PLAYS 



1440 




SET HIGHLIGHT 



/I 



1446 



LOAD URL 



z: 



7448 



PLAY 




CHANGE 
SEQUENCER 
DSO CHECK 
FIELD 



If 



1432 



USE 
DEFAULT 
SIZE 



RESIZE IMAGE 
DISPLAY 



z: 



1434 



BOUND DHTML 
CHECKBOX 
UNCHECKS 



1416 



J 



r 



1450 



STOP 




YES 



z: 



1452 



START DEFAULT 
BANNER 
ROTATION 



z: 



7422 



CENTER 
DISPLAY 
IN HOME 
POSITION 



z: 



7424 



DONT 
MOVE 



FIG.. 14 



11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. 17, 2002 sheet 17 of 19 US 6,452,609 Bl 



DRAGGING BANNERS 



MICON 
BANNER 
DRAGGED 



1502 



1534 




PLAYER 
RESUMES 



1510 



BANNER 
DISAPPEARS 




GET MEDIA 
OBJECT URL FROM 
SEQUENCER DSD 
CURRENT RECORD 



CHANGE 
CURRENTLY 
PLAYING 
HIGHLIGHT TO RED 



1540 



PLAY BANNER 
MEDIA OBJECT 



AT PLAY END 
CHANGE 
HIGHLIGHT BACK 
TO YELLOW 



1542 



1544 



RESTART CURRENT 
MEDIA OBJECT 



1546 



CREATE NEW 
SEQUENCER 
DSO RECORD 



1520 



COPY USER 
&TAB ID'S 
TO RECORD 



1522 



COPY BANNER 
MEDIA OBJECT 
DATA TO NEW 
RECORD 



1524 



NEW DSO 
FIELD UPDATES 

BOUND 
PLAYLIST TABLE 



1526 



FIG.. 15 



11/28/2003, EAST Version: 1.4.1 



U.S. Patent 



Sep. 17, 2002 



Sheet 18 of 19 



US 6,452,609 Bl 



OPENS MICON POP-UP 



USER 
CLICK 



1600 



r 



1602 



GET SPONSOR OR 
PLAYER POP-UP 
STRING FROM 
SEQUENCER DSO 
CURRENT RECORD 



1604 



SHOW 
BUILDING 

MENU 
MESSAGE 



r 



1606 



PASS 
STRING TO 
POP-UP 
ENGINE 



POP-UP ENGINE 



1610 



PARSE STRING 
. SECTION 



1626 



SELECT 
HIGHER MENU 




1634 



2^ 



END OF STRING 




1616 



SELECT 
LOWER MENU 



TEST FOR <, 
DATA, > 



1628 



BUILD MENU 
LEVEL 



ZL^^ 1618 



PARSE DATA 



1632 



TEST 
FOR LOWERS 
MENU 
LEVEL 

? 

^ .NO 



BUILD MENU 
LEVEL 



CREATE MENU 
ITEM 



POP-UP MENU BUILDER 



INSERT MENU 
DIV 



INSERT MENU 
BORDER 



J 



INSERT 
TEXT/GRAPHICS 



OPEN TABLE TAGS 



CREATE MENU 
ITEM ROWS 



ADD CLOSE 
TABLE TAGS 



END OF ITEMS 



1650 



FIG.. 16 



11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. 17, 2002 sheet 19 of 19 us 6,452,609 Bl 



Preview » 

Description > 



Info 
Source 
Sponsor 
Buy 



Unlock 



H Title 
Author 
Copyright 
t\ lUiodify Date 
Details I 



IMedla lype t> 
Frame Rate t> 



102 Height X 100 Width 



11/28/2003, EAST Version: 1.4.1 



us 6,452^ 

1 

WEB APPLICATION FOR ACCESSING 
MEDIA STREAMS 

BACKGROUND 

The present application relates generally to providing 
media streams fi:om Internet sites. 

The World Wide Web (WWW) is conventionally con- 
ceived as a system in which a user navigates between text 
documents on different servers by means of hypertext links, 
Activating a hypertext link causes another page, also com- 
posed of text and Unks, to be delivered to the client com- 
puter. Thus, on the WWW, a user's experience is determined 
by the order in which the user chcks on links. 

In general, non-text objects are treated as illustrations 15 
placed on text pages. Although WWW standards include an 
open ended specification for handling multimedia files that 
allows media objects to be referenced by hypertext links, 
those references are treated no differently than hypertext 
links to pages and illustrations. Typically, three techniques 20 
are used to access multimedia files. First, a link can point to 
a special media file that requires a special player program to 
produce the images and sounds of the media file. Second, the 
link can point to a player program that starts independently 
of the web browser to play the media file. The interface 25 
provided by the player program controls the media file. 
Third, the link can point to a player program embedded in 
the page. In this case, the liser can click on the link to choose 
which media file to play without leaving the page. However, 
the size of the image displayed and the controls available to 30 
the user are chosen by the web page designer. 

The currently available tools that can be used to synchro- 
nize the presentation of multimedia components include 
proprietary languages, such as Macromedia's Lingo and 
Apple's HyperCard, and scripting languages, such as ^5 
ECMAScript (JavaScript). In recognition of the difficulty of 
multimedia authoring with the currently available tools, the 
World Wide Web Consortium (W3C) has proposed a new 
language called the Synchronized Multimedia Integration 
Language (SMDL). 40 

The WWW was developed for utihty in the assembly and 
cross referencing of text content documents with user fi:ee- 
dom in navigation. On the other hand, multimedia develop- 
ment has focused on interactive but canned content with 
limited use options that are defined by the author. Thus, 
multimedia on the web has been subject to conflicting 
developmental pressures, and has not developed a coherent 
presentation format. 

SUMMARY 50 

In one aspect, the invention is directed to a web page with 
a player for playing media objects, a sequencer which 
displays a play list that defines an order in which media 
objects are played by the player, a media access area for 55 
containing a plurality of graphical icons. Each graphical 
icon representing a media object, and the graphical icons can 
be manipulated by a user to modify the play list. 

Implementations of the invention may include the follow- 
ing features. The graphical icon includes an indication of a 60 
media type of the media object and text describing content 
of the graphical object. A graphical icon can be dragged 
from the media access area to the sequencer to add the media 
object represented by the graphical icon to the play list. The 
sequencer can display one of multiple play fists, and the user 65 
may switch between play lists by selecting a tab associated 
with the play list. For each graphic object in the play list, the 
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play list box may contain a copy of the graphical icons 
representing the graphical object, a checkbox to control 
whether the player will play the graphic object, and a pop-up 
menu to provide information about the graphic object. The 
sequencer and media access area may be implemented with 
scripted DHTML. The media access area may include an 
expandable and collapsible outline of subjects, and the 
media icons may be arranged in lists in the outline. The 
media access area may include a tab for each subject at a top 
level of the outline, and the user can switch between subjects 
by selecting a one of the tabs. The media access area may 
display one of a plurality of outlines, and the user can switch 
between outlmes by selecting a tab. The player may include 
a control panel and a draggable image display window The 
image display window may include a home button to return 
the image display window to a home position on the web 
page, an image area, a handle, a button to hide the image 
area, and a size lock button to prevent the image display 
window firom expanding beyond a default size. The web 
page may further include a site-driven area to display a 
banner. The banner may be synchronized with the media 
object being played by the player, and a media object may 
be associated with the banner. The user may change the play 
list to play the media object associated with the banner by 
manipulating the banner. Dragging the banner to the 
sequencer may add the media object associated with the 
banner to the play list, and dragging the banner to the unage 
area of the player may play the media object associated with 
the banner. ITie banner may include a pop-up menu to 
display information about the media object associated with 
the banner. 

In another aspect, the invention is directed to a method of 
operating a web page. Multiple sources of streaming content 
are displayed to a user, and user input is received to select 
a playing order for the sources of streaming content. The 
playing order is stored, user input is received to start 
delivering the streaming content to the user, and the stream- 
ing content is presented to the user in the stored order. 

In another aspect, the invention is directed to an Intemet 
site having a first database to store information about a 
pluraHty of media objects, a second database to store infor- 
mation about how the media objects are to be presented on 
a web page, a third database to store information about a 
plurality of users, and an appHcation server for communi- 
cating with a client running the web page. 

Advantages of the invention may include one or more of 
the following. The user can locate and control streams of 
multimedia content in real time without accessing different 
web pages or surrendering control to a media player pro- 
gram. A user can define and assemble multiple sequences of 
media objects, particularly sources of streaming content. 
The user can manage a persistent personal collection of 
media objects from a network client. The user can gather 
additional streaming content while a media object is playing, 
and can modify and create sequences while a media object 
is playing. The user can add and remove media objects from 
a sequence, can deselect media objects to prevent them from 
playing without removing them from a sequence, and can 
switch between different user defined sequences. New media 
objects can be preloaded into a sequence based on a personal 
preference or interest profile defined by the user. Individual 
user histories (as defined by the order in which a user adds 
media objects to sequences and plays the media objects) can 
be used to generate an outHne organized by user-defined tabs 
and dates. Users can exchange play lists and player combi- 
nations by electronic mail. 

The details of one or more embodiments of the invention 
are set forth in the accompanying drawings and the descrip- 
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tioQ below. Other features and advantages of the invention adornment for the hypertext. In contrast, in the pageless 

will become apparent from the description, the drawings, Internet site, the media object is the starting point. The 

and the claims. pageless Internet site is media-oriented, as opposed to being 

text-oriented with media annotations. In short, the principle 

BRIEF DESCRIPTION OF THE DRAWINGS 5 of organization of web page 10 is the relationship between 

media objects, rather than the relationship between pages. 

FIG. 1 mustrates a media access web page according to ^ ^^^^ ^ ^^^^^ ^^^^^ ^^^^ 

the present mvention. f^m- fQuctional areas, including a media icon access panel 

FIGS. 2A-2C illustrate the use of a media icon access 12, a sequencer 14, an object player 16, and a site-driven 

panel from the web page of FIG. 1. area 18. The media icon access panel 12 organizes media 

HGS. 3A-3B illustrate the step of dragging a media icon icons into a hierarchical ouQine or list, and supports searches 

from the access panel to a sequencer from the web page of for "^^dia objects. The sequencer 14 allows the user to select 

PIG. 1. media icons from the media icon access panel 12, and to 

FIG.' 4 iUustrates the sequencer containing several media "f** '^°J^y °' P^'^l ^f j^^ 

.^^^^ 15 object player 16 plays the media objects m the order defined 

^ ^ , ^ , . by the play list. In addition, the object player 16 can control 

FIG. 5 Illustrates the use of a media object pop-up menu. ^^e play list and the individual media objects in the play list. 

FIGS. 6A-6C illustrate the manipulation of multiple play The site-driven area 18 presents site-driven graphics syn- 

lists by the sequencer. chronized with streaming content that responds to user 

FIG. 7 illustrates the object player from the web page of ^ actions and user selected content. The graphics can also be 

FIG. 1. media icons representing more media objects. The web page 

FIGS. 8A-8C and 9A-9C illustrate the operation of the 1^ can be implemented with JavaScript and HTML 4.0, and 

site-driven area from the Internet site of FIG. 1. can be accessed with a web browser, such as Microsoft 

FIG. 10 iUustrates a pageless Internet site for generating ^^^^^^fjS ^"^^r'/'^^'-u "f^ component of the web 

a media access web page. 25 P^^^ ^^^^ described in greater detail below 

T-r^ ^-1 M . . J ^ J L The media icon access panel 12 has a series of subject 

FIG. 11 illustrates a method performed when a user * u n j i ^ r*u i u • 

, , , . ^ matter tabs 22 arranged along an edge of the panel. To begin 

contacts a media access web page server, , • .|_ 7^ c^x. u *l 1 rfu 

^ * browsmg the content 01 the site, the user selects one of the 

FIG. 12 illustrates a method performed when a user subject matter tabs 22, for example, by cUcking on it with a 

interacts with the media icon access panel. ^o^e controlled cursor. As shown in HG. 2A, clicking on 

FIGS. 13A-13C illustrate methods performed when a a subject matter tab 22 causes the top level of an outline 24 

user switches or changes tabs in the sequencer. to appear as a bulleted list containing bulleted items 26. In 

FIG. 14 illustrates a method performed when a user plays addition, clicking the subject matter tabs 22 causes outline 

a media object from a play list in the sequencer. item tabs 28 to appear at the bottom of the media icon access 

FIG. 15 Ulustrates a method performed when a user drags 35 P^nel 12. Each outhne item Ub 28 conesponds to one of the 

a banner from the site^iriven area. ^op level bulleted items 26 m the outline 24. 

FIG. 16 illustrates a method performed when a user j^/^^* °^ either the text of a 

activates a media icon pop-up menu. ''/^^^^^^ ^^^"l^^ ^^f. correspondmg outhne item tab 28 at 

_ _ ^ - ... \. . the bottom of the media icon access panel 12 will cause the 

FIG. 17 lUustratcs a media icon pop-up menu. ^ ^^^j j^^^i ^^jline to be di^layed as a bulleted sublist 

DETAILED DESCRIPTION Qicking on a bulleted item in a sublist causes the next 

lower level of the outline to be displayed. In order to manage 

FIG. 1 shows a media access web page 10 generated by large outlines without excessive scrolling, the sections of the 

an Internet site that is particularly suited for accessing outline will expand and collapse so that only one item of 

multimedia streams. The Internet site is "sequence- 45 each level of the outline is expanded at a time. For example, 

oriented", i.e., the user controls the sequence in which FIG. 2B shows the "News" section of the outline has been 

multimedia streams are presented. In addition, the Internet expanded. Clicking on any bullet at the same level, such as 

site is "pageless", in that media streams are delivered to the the "Sports" bullet, would expand the outline to show the 

user without the user having to navigate to different pages. items in that bullet, but would also close the "News" section. 

The media streams may be a variety of media types, such as 50 As shown in FIG. 2C, the lowest level of the outline is a 

text, audio, images, animation, video, executable code, or list 36 of media icons 30. Each media icon 30 represents a 

any combination of media types. The Internet site is a media object. Each media icon includes a graphic icon 32 

media-type neutral system, i.e., it treats different media indicating the media type, such as audio, video, text, execut- 

types, such as audio and video, in a similar fashion. able code, graphic, or unknown, of the media object. Each 

The building blocks of the Internet site include playable 55 media icon also includes accompanying text 34 to briefly 

media content units, called "media objects", and graphical explain the content of the media object. When a cursor 42 

representations, of the media content units called "media moves over a media icon, the media icon is highlighted to 

icons". The user manipulates the media icons to create an indicate that it is selectable. Qicking on a media icon 30 

individual sequence, i.e., a play list, of media objects. The does not open another level of the outline. Rather, as shown 

web page 10 presents the media icons with text and/or go in FIG. 3A, holding the mouse select button down when a 

graphics to assist the user in determining how to manipulate media icon is highlighted creates a copy 40 of the selected 

the media icons. media icon, in a contrasting color. The user can drag the 

The pageless Internet site is an inversion of conventional media icon copy 40 with the cursor 42. As shown in FIG. 3B, 

web site design. In conventional web site design the media the media icon copy 40 can be dragged out of the media icon 

object is the last hnk in a long chain of pages and links. The 65 access panel 12 and dropped into the sequencer 14. 

setting, context, meaning, and relevance of the media object As shown in FIG, 4, the sequencer 14 includes a play list 

are established in hypertext, and the media object is an box 44, a play list button 46, and control buttons 48. When 
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the copy of the media icon is dragged near the sequencer 14, As shown in FIG. 7, the object player 16 is used to play 

it will snap into the play list box 44. By dragging media the currently selected media object from the play list 50 in 

icons from the media icon access panel 12 into the sequencer the sequencer 14. Hie object player includes an image 

14, the user creates a sequence or play list 50 of media icons display window 80 and a control panel 82 . The object player 

representing a playing order for the media objects associated 5 16 can use any program that can be embedded in a web page 

with the media icons. Media objects can also be added to the that presents media objects. Examples of streaming media 

play list 50 by double-clicking on the media icon 30 in the programs that can be embedded are QuickTime™, 

outline 24. Each element in the play list 50 includes the copy RealMedia™, and Microsoft Media Player™. Streaming 

40 of the media icon, a checkbox 54, and a pop-up icon 56. media players, such as the illustrated RealMedia Player, 

The user may select one of the media icons 30 in the include the control panel features, such as a stop button 100, 

sequence by clicking on it to make it the current media icon a pause/play button 102, a previous button 104 and a next 

52. The current media icon 52 is highlighted in yellow and button 106. a vertical-slider control 108 provides audio 

represents the media object that is playing, or that will play volume control, and a horizontal slider control UO provides 

if a stopped player is started. If the number of elements in fast forward/rewind control and indicates the amount of the 

theplay list 50 exceeds the vertical height of the play list box stream that has been and remains to be played. A display 

44, a scroll bar may be created to scroll through the play list. panel 112 presents the current status of the media object, 

The user can modify the play list 50 to arrange the media e.g., playing or paused, and a clock 114 shows the total 

objects into a desired playing order. For example, the user duration of the multimedia object and the elapsed time, 

can change the order of media icons by dragging the media Hie next button 106 works with the play list 50 in the 

icon copy 40 inside the play hst box 44. Clicking on a sequencer 14 to cause the currently playing media object to 

remove button 60 below play list box 44 deletes the current stop and to cause the media object represented by the next 

media icon, and clicking on a clear button 62 removes all checked media icon in the play list 50 to start playing, 

media icons from the current play list 50. Unchecking the Similarly, the previous button 104 causes the currently 

checkbox 54 to the left of the media icon copy 40 will cause playing media object to stop and causes the media object 

that media object to be skipped when the play list is played. ^ represented by the previous checked media icon in the play 

This permits the user to select a subset of a play list 50 to be list 50 to start playing. When a new media object starts 

played. playing, it is highlighted in yellow as the current media icon. 

As shown in FIG. 5, additional information about each If there is no checked media icon in the play hst before the 

media object is accessible by clicking on the pop-up icon to current media icon, the previous button 104 is dimmed, and 

generate a pop-up menu 58. This information wiU depend on 33 if there is no checked media icon is the play list after the 

the nature of the media object, and can be determined by the current media icon, the next button 106 is dimmed, 

manager of the Internet site. For example, the pop-up menu The image display window 80 includes a handle 90, an 

can display information about image size, media type and image size lock button 92, a window shade button 94, and 

frame rate. an image swap button 96. The image display window 80 has 

As shown in FIG. 6A, the user can create and organize 35 a home position in the upper left comer of the media access 

multiple play lists by use of the play list button 46. When the web page 10. However the user can reposition the image 

user clicks on the play list button 46, a pop up menu 70 display window 80 by clicking on the handle 90 and 

appears with four options: Create, Delete, Rename, and Go dragging the image display window. When the image dis- 

To. The create option adds a play Hst, the delete and rename play window 80 is dragged out of its home position, it floats 

options remove and rename a play list respectively, and the 40 above the other areas of the web page 10 and the sequencer 

Go To option switches to a different stored play list. As 14 expands to make use of the freed space to provide a larger 

shown in FIG. 6B, each new play list creates an additional play list box. On the other hand, if the image display window 

tab 72 at the top of the play hst box. The new play list 50 80 is dragged back to its home positions, it will snap back 

may be populated by dragging media icons from the Same or to the home position and the sequencer 14 will shrink to its 

different branches of the outline 24. The user created play 45 . original size. 

hsts are similar in function to the favorites or book marics The user can click on the image size lock button 92 to set 

web browsers have for web pages. The pop-up menu 70 may and release an image size lock that restricts the maximum 

also include a Play All option which causes every play list size of the image display window 80. When the image size 

to be played. In addition, the pop-up menu 70 may include lock is released, the image display window 80 will resize to 

a Play Many option which allows the user to select a group 50 the default size of the particular media object. On the other 

of play lists, e.g., by selecting the play list tabs 72, and to hand, if the image size lock is set, the image display will not 

play the media objects in the group. The functions of the grow larger than the default size of the image display 

play list button 46 could be accessed by other interactive window 80. However, the first time in a session when an 

features on the web page. unage that is larger than the image display window default 

Hie pop-up menu 70 on the play list button 46 may also 55 size becomes current, a dialog box adcs whether the user 

include a mail feature that permits users to select and wishes the display to expand to the normal image dimen- 

exchange play lists. The mail feature may also be invoked by sions required by the media object. If the user agrees, then 

a separate button, or by dragging media icons from the image lock is released and all unages larger than image 

sequencer or media icon access area to a mailbox icon. The display window defauh size will display full size. The size 

media objects in the mailbox may later be mailed one or eo of the image display window 80 may also be set by dragging 

several receipients. on the window edges. 

As shown in FIG. 6C, when the addition of a new tab 72 Clicking on the window shade button 94 removes the 

causes a tab at the opposite end to "fall off" the play list box image but leaves the handle 90. CUcking the window shade 

44, a triangular comer marker 74 appears to indicate the button 94 again restores the image. ITiis is useful for quickly 

direction in which there are more tabs to view. The user can 65 seeing what is beneath the image without repositioning it. 

click on the comer markers 74 to cause the tabs to shift left The position swap button 96 changes the position of the 

or right, as appropriate, to display the next play list tab. image display window 80. When the image display is 
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floating, clicking the position swap button 96 returns the 
image display to the home position. Clicking the position 
swap button 96 when the image window is in its home 
position returns it to is last floating position. The hide video 
button 98 hides the whole image display window 80, includ- 
ing the handle 90, For example, the image display window 
may be hidden* to enlarge the sequencer 14 when working 
with audio-only media objects or if no video image is 
desired. The user redisplays image display window 80 by 
clicking the show video button below the sequencer 14. The 
image size lock, image shade, image swap buttons and hide 
video on the handle 90 of the image display window 80 are 
repeated below the sequencer 14 as a lock/unlock button 68, 
an open/close button 66, an away button 69, and a hide/show 
video button 64, respectively (see FIG. 4). 

As shown in FIGS. 1 and 8A, the site -driven area 18 is a 
region of the web page 10 that is controlled primarily by the 
server in response to user actions. The contents of this 
synchronized display are not chosen by the user, but instead 
are determined by the Internet site application program. The 
Internet site can use the site -driven area 18 to present 
information, e.g., a rotating banner, associated with media 
objects that are playing. The contents of site-driven area 18 
can also be based on user preferences, a user history, or a 
user profile. For example, when the media access web page 
10 first loads, and if no media objects are playing, the 
site-driven area 18 can show a conventional "rotating" 
advertising banner 120. However, as shown' in FIG. 8B, 
when a media object is playing, the site-driven area 18 
shows a rotating banner 122 that is specific or "synchro- 
nized" to the media object. For example, if the user plays a 
chp from a music video, an advertising banner for a CD from 
the same record label can be displayed in the site-driven area 
18. Thus, the synchronized banner 122 provides information 
in parallel with the playing media object. 

Each media object represented in the media icon access 
panel 12 can have none, one, or two or more synchronized 
banners 122. For example, one banner can reference a 
source (e.g., the web page where the media object was 
found) for the media object, and another banner can refer- 
ence a sponsor (e.g., the company whose product is 
advertised) for the media object 

Each synchronized banner 122 can be associated with a 
playable media object. If a media object is associated with 
the banner 122, an indicator 130 appears in the frame of the 
banner 122. The indicator 130 can show the type of the 
media object (e.g., video, audio, etc.) with a graphical icon 
102. The user can play the associated media object by 
dragging the banner 122 into the image display window 80 
of the object player 16. In addition, the user can add the 
associated media object to the play list 50 by dragging the 
banner 122 into the play hst box 44 of the sequencer 14. 

As shown in FIG. 8C, dragging the banner 122 creates a 
copy 132, which acts as a media icon. When the dragged 
banner contacts the image display window 80, the image 
display border turns yellow to indicate it will play a new 
media object. Dragging the banner copy 132 into contact 
with the image display window 80 causes the object player 
to pause, and releasing a dragged banner copy 132 in contact 
with the image display stops the playing of the current object 
and starts playing the object associated with the banner. The 
highlight on the current media icon 52 in the play fist 50 
turns red to indicate that the play fist is stopped. However, 
a media icon for the new media object is not added to a play 
hst. Instead, once the media object associated with the 
banner is finished playing, the play list resumes playing with 
media object that was interrupted by dragging the baimer. 
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As shown in FIGS. 9 A and 9B, the site-driven area 18 can 
display information related to the associated banner or 
media object. This is indicated by a button or icon 134 
appearing in the site -driven area 18. If the user clicks on the 

5 button 134, an expanded site -driven area 136 is opened. The 
expanded sponsor area may provide additional information 
(if any is available) details regarding the subject matter of 
the banner. For example, a more extensive advertising page 
may be presented. 

10 The user can click on the media object indicator 130 on 
the banner 122 to open a pop-up menu 138. The pop-up 
menu functions are defined by the banner 122. Selecting 
"Play" can have the same effect as dragging the banner to the 
image display, i.e., the media object is played immediately, 

15 Selecting "Play Later** causes the media icon for the media 
object to be added to the end of the current play list 50, Other 
menu options may permit the user to visit the sponsor's web 
site or purchase products shown during presentation of the 
media object. 

^ When the media access page loads, the sequencer 14 will 
be empty if the user has not visited the site before and if the 
site has not pre-loaded the sequencer 14 with any media 
icons. As the user loads the sequencer 14 with media icons, 
a record of the sequencer's contents is saved on the site 

^ server. This session state is preserved between visits, so that 
when the user returns to the site, the sequencer will contain 
the same content with which the user ended the previous 
session. In addition, the site managers have the option of 
selectively creating and preloading play lists and tabs for 
each user. Users can be notified about content which is no 
longer available and it can be removed from user play fists. 

In addition, the user can create a personal preference 
profile that determines content to be preloaded into the 

2^ sequencer 14. For example, while browsing through the 
outline 24 in the media icon access panel 12, the user may 
select an interface feature, e.g., a button, to indicate that the 
user is interested in receiving content related to the subject 
matter currently displayed in the outline. When the user 

^ returns to the site, the sequencer will be preloaded with 
media icons that fit the user's personal preferences. The user 
preference profile can be complex, and can be generated 
using the taxonomy of the outline. The result of the preload 
may be a topical set of play lists in the categories established 

4j by the user. Multiple interface methods can be used to 
generate the profile. An appropriate interface method may be 
selected depending on the nature of the content. The per- 
sonal preferences selection method may be accessed by a top 
level tab of the media icon access panel 12, or otherwise may 
be a primary user interface. 

The media icon access panel 12 may permit a user to view 
a history of the user's media object selections. For example, 
one of the tabs on the media icon access panel can display 
an outline of all play lists that have been created or all media 

55 objects that have been added to the sequencer. Hie outline 
may be organized by date, tab name, or current play list tab 
names. Thus, over time, the creation of play fists and play 
list tabs sequencer labs gives the user the option to view a 
personalized access area, e.g., an outline 22 in the described 

60 implementation, on the media icon access panel 12. 

The selection and playing of media objects is tracked, so 
that the user may later request previously played media 
objects, e.g., by date of selection or playing, or reconstitut- 
ing play lists that have been deleted fi:om her sequencer. 

65 Alternately, the user may apply a filter based on prior 
selections. For example, the user may elect to view only 
media objects that have not been played, or only media 
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objects that were played last week. The user can create a 
personal preference that preload previously created play lists 
into the player. 

Hius, users can interact with content that is pre-loaded in 
the sequencer (either by the site-manager or based on 
personal preferences), they can locate new media objects in 
the media icon access panel 12, organize the media objects 
into a play list 50 in the sequencer 14, exchange play lists 
with out users, and elect to review media objects that are 
offered in the sponsor area during the playing of each media 
object. 

As shown in FIG. 10, a p ageless Internet site 1000 for 
generating a media access web page includes server com- 
ponents 1002 and browser components 1004. Databases, 
including a content database 1010, an interface database 
1012, and a user database 1014 are associated with the 
server 1002. 

The content database 1010 contains information about the 
media objects that will be represented by media icons in the 
pageless Internet site. For example, the content database 
1010 can inchide, for each item of content, the media type, 
i.e., video, audio, animation, and the like, a uniform resource 
code, a short text description, such as the title of the media 
object, the frame rate, duration and image size. The content 
database may also contain information about the origin of 
the media object, such as the author, copyright source name, 
source web site, sponsor name, and sponsor web site. If the 
media object represents an item that can be purchased, then 
the description and price of the item may also be stored in 
content database 1010. The content database may be updated 
periodically by the Internet site manager to provide new 
media objects to users, and to remove media objects that are 
no longer available. 

The interface database 1012 contains the information 
required to support the generation of user interface elements 
in the media access web page. Specifically, the interface 
database 1012 includes tables that are used by queries to 
construct the outline 24 in the media icon access panel 12. 
The interface database 1012 includes a master outline ref- 
erence table that contains one record for each method of 
constructing a level of the outline. Each record contains 
information to define the format of the level and to construct 
queries in the client that will obtain the level below the level 
currently being displayed. One implementation of the master 
outline reference table includes the following fields 



Levelcode 
Levelcodenext 
Query code 

Drag 

Color 
Tab 

Fieldl-10 
Sort 

Adjcodc 
Writecode 



a label for the outline level type 

the label for the next lower outlLne level type 

a label for a structured query language (SQL) format 

query 

determines whether the elements on the level arc 
draggable 

determines the color of the elements on the level 

determines whether the elements on the level should be 

repeated in tabs, e.g., bottom or side tabs 28 

names for up to two tables used in the query 

names for up to ten fields used in the query 

a sorting order for elements on the level 

a name for the block of HTML display script 

determines whether the level writes, overwrites 'or adds to 

an existing level 



Hie user database 1014 maintains information about the 
content and the status of the play lists in the sequencer For 
example, the user database 1014 may include the user's 
name, password and other personal information, as well as 
user profile and preference information that might be devel- 



10 



15 



oped by the pageless Internet site manager. The user data- 
base 1014 can also contain a list of the play lists available 
to the sequencer 14, a list of the media objects in each play 
list 50, and identification of the currently selected play list 
and media object. The user database 1014 can also maintain 
a history of the use of the web page 10 by the user, e.g., by 
tracking the media objects put into the sequencer 14 and the 
order in which they are played by the player 16, 

The server components of the pageless Internet site 1000 
also include a web server 1020 and one or more media 
servers 1025. In brief, the web server 1020 receives queries 
from the client, passes the queries to the databases, receives 
the resulting recordsets from the databases, and delivers 
those recordsets back to the client. The media servers 1025 
host the media objects and manage the serving of streaming 
media objects. 

Hie web server 1020 serves the media access web page 
into a client 1030. A browser running on the client interprets 
the web page and displays it to the user. The web page 
contains the program that displays the interface controls, 
responds to user events, sends queries and updates to the 
web server 1020, receives and manipulates recordsets from 
the web server 1020, formats data for display, and controls 
the media player object. The web page also includes a 
number of data source objects (DSOs) 1034. In general, 
there are at least two independent database coimections for 
the client. One connection is to the interface database that 
views the content database, and the other connection is to the 
user database and is bidirectional to the sequencer in support 
of user activity and history. Data in the data source otajects 
can be bound to dynamic hypertext markup language 
(DHTML) objects so that changes in the DSO data result in 
updates to the client display. Specifically, the web page will 
include a sequencer DSO that is bound to the sequencer 
DHTML. The data source objects 1034 can pass query 
statements, e.g., in structured query language (SQL), to the 
web server 1020, and receive recordsets in return. 

The DHTML for the media icon access panel 12 includes 
an array with an entry, e.g., a row, for each element in the 
40 outline 22 that is being displayed. Each entry contains all the 
information necessary to construct and format the outline 
element, and, if the element is a media icon, all the infor- 
mation about the media object, including type of the media 
object, the banners associated with the media object, the 
45 pop -up menus, and the media objects associated with the 
banners. 

As shown in FIG. 11, when the media access web page is 
loaded, it checks for the existence of a cookie that can 
identify the user to the web server 1020 (step 1102). If a 
cookie is found, then the client queries user database 1014 
in the server for the contents of thie sequencer 14 at the end 
of the user's last session (step 1104). The server responds to 
this query and the sequencer DSO is loaded with the 
sequencer tab categories and play lists 50 (step 1106). In 
addition, media objects may be pre-loaded into the 
sequencer DSO based on an individual preference profile 
(step 1108). For example, a user may request to receive news 
updates, and this information would be stored in the user 
database 1014. Media objects added to the site since the 
user's last visit that fit the individual preference profile could 
be loaded into a "new" category on the sequencer tab. Next, 
site specific media objects may be pre-loaded into the 
sequencer DSO (step 1110). For example, tabs and play lists 
that the pageless Internet site manager wishes to be dis- 
played when the user visits the site may be loaded. Next, the 
initial state of the access panel 12 is determined (step 1112). 
Specifically, a pre-defined initial query is sent by the client 
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to the interface database 1012, and the interface database sequencer DSO when a user adds a media object to a play 

responds with a recordset that describes starting state of the list. Since the play list 50 is data-bound to the sequencer 

access panel. The outline information and top tab names DSO, updating the recordset of the sequencer DSO adds a 

from this recordset are loaded into the access panel DSO. media icon to the bottom of the play list 50, Then the 

Finally, the site-driven area is activated to commence con- 5 sequencer DSO updates the user database 1014 (step 1228). 

ventional banner rotation (step 1114). . . . , 

,™ , ^ .\ ^ \ . . ^ , As shown in FIG. 13A, when the user cbcks a new 

Ir the user has not visited the site before and, * u / * iiaa\ *». r^c^r^ u m 

^ ^ „ ,1 1 ■ 1 * J • * J • sequencer tab 72 (step 1300), the sequencer DSO submits 

consequently, no cookie IS located, a new user IS created m P ... **u 1 1** *i: j * u 

..Jl^ Ar./„L„^^ M\^A r * iiin\ Tn, * changes m the current tab play list to the user database 1012. 

the user database 1014 (step 1120). The server generates a ™ . . , j- ^ . - , ✓ . 

aew user identification code (step 1122) and writes a cookie „ TJif.f ^Sf^ '"^1* f source for the object player (step 

with the user identification code which is dcUvered to the " ""l^" P^' fj'"^' ^^'^"'^ f!*^! ^ J'^^l 

1* iii>i\TL 1- checked object in the new play list 50. The play hst for the 

client (step 1124), The application server 1020 then com- . . • ^i. j j i ^ ^ ^ « j ^ 

„^ 1 J- A J- u- * • 4 *i- new tab is filtered and loaded from the sequencer DSO 

mences loading the site specific media obiects into the . . . ^. . ■ * , . 

sequencer DSO in step 1110 recordset. Because the play hst 50 is bound to the sequencer 

T-T^ -11 . . , ^ J u 1 DSO, it shows the media objects associated with a new tab. 

FIG. 12 illustrates the steps performed by the pageless 15 , , 

Internet site 1000 when the user is navigating through the ^^^^ ^^^^ ^^^^^^ 

ouUine in the access panel 12. In brief, clicking on a tab or "^^^^ ^ ^^^^^^^ ^"""^ sequencer DSO, 

outline line in the new media icon access panel 12 generates corresponding bound DHTML object is updated 

an SQL query of the interface database 1012 which returns accordmgly. Similarly, if the user clicks on the clear button 

a recordset containing the elements to be displayed and the 20 ' objects records from the current tab assignment 

format. As mentioned above, the interface database includes ^""^^^^^ ^^^^ sequencer DSO, thereby updating the 

a record for eac^ element in the outline (whether shown on corresponding bound DHTML play list. In both cases, the 

media icon access panel 12 or not), and the array in the sequencer DSO submits changes in the play list to the user 

access panel DHTML includes an entry for each element 26 database 1014. 

that is currently visible on the media icon access panel 12-25 ^ shown in FIG. 13B, changes to the sequencer tabs 

Specifically, each entry in array contains the level of the using the create, delete or rename functions in the pop-up 

element, the text associated with the element, the format for pl^y list menu 70 cause changes in the corresponding 

the element, and sufficient information to constmct a query records in the sequencer DSO. The DHTML objects bound 

to obtain a recordset from the interface database for the level to the tab sequencer DSO are also rewritten to update the 

below the displayed element. If an element in the displayed 30 visual appearance. In addition, the tab sequencer DSO 

outline 24 is clicked, a script is run which generates a query submits the changes to the user database 1014. 

that is sent to the interface and content databases. The As shown in FIG. 13C, the Javascript embedded in the 

databases return a recordset that is stored in a temporary web page 10 includes a tab display manager 1350 that is 

access panel DSO. The recordset is copied to the DHTML activated when the user clicks a left tab button, a right tab 

array, and the accesspanel DSO is cleared. Information from 35 button, creates or edits a tab, or when the user database is 

the DHTML array is used to write, add or overwrite DHTML first loaded into the sequencer DSO. The tab manager 1350 

to a DHTML span which describes a display region on the stores variables representing the first and last visible tabs, 

media icon access panel. Since the formatting information is The tab manager 1350 adds the left or right tab comer 

taken from the interface database, the media icon access marker buttons 74 to the left or rightmost tabs when there are 

panel 12 can be transformed without reloading any page or 40 more tabs available to the left and/or right. For example, 

frames. assuming the user has clicked the tab-left button, the vari- 

If the user clicks on a tab 22 or an outline line 26 (rather able representing the first tab is decremented by one (step 

than a media icon 30), the outline is collapsed so that other 1352). Then the variable representing the last tab is set by 

outline elements at the same level are closed (step 1202). A setting it equal to the first tab and incrementing it until either 

wait message, e.g., "retrieving element," may be displayed 45 the last tab is reached or no more tabs fit on the access. The 

to the user (step 1204) while the client retrieves the SQL tab display manager can calculate whether tabs fit on the 

query data from chent memory (step 1206), generates an play list box by storing the horizontal length of the play list 

SQL query that is sent to the application server 1020 (step box 44 and the horizontal length of each tab 72. The visible 

1208) and receives a resulting recordset which is copied to tabs are positioned (step 1356) and the tab left and tab right 

a DHTML array (step 1210). The new outline is formatted 50 buttons are reset depending on whether there are additional 

and displayed (step 1212). tabs to the left or right. Similarly, if the user clicks a right tab 

If the user clicks on a media icon 30, the media icon is button, then the variable representing the last tab is incre- 

copied to a DHTML layer that represents the top layer to be mented by one (step 1362) and the variable representing the 

displayed by the client (step 1220). The color of the media first tab is determined by setting it equal to the last tab and 

icon is changed to a "dragging" color. The client then detects 55 decrementing it until either the first tab is reached or no more 

whether the media icon has been dragged to the sequencer tabs fit on the play list (step 1364). Then the visible tabs are 

(step 1222). If the mouse button is released before the media positioned (step 1366) and the left and right tab buttons are 

icon overlaps the sequencer 14, then the copied media icon reset (step 1358). 

is removed from the drag layer and disappears (step 1224). As shown in FIG. 14, when a user plays a media object 

On the other hand, if the mouse button is released when the 60 from the play list 50, e.g., by pressing play button 85 (step 

media icon overlaps the sequencer 14, then the record 1400), a JavaScript function is triggered which generates a 

associated with the media icon is copied from the access user interface command that is sent to the media player 

panel array to a JavaScript anay and appended to the object 1036. In response, the media player abject 1036 

sequencer DSO (step 1226). Thus, all the information for the signals the appropriate media server 1025, which retrieves a 

media object associated vnth the media icon, including the 65 media stream from the source specified in the media icon 

media object's pop-up menu, associated banners, and banner record (step 1402). Rotation of the default banner stops (step 

pop-up menus is copied from the access area array to the 1404), and the sponsor's URL is retrieved from the 
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sequencer DSO (step 1406). Id addition, the specific banner 
associated with the media object, e.g., a sponsor banner or 
a source banner, is displayed in the site-driven area 18 (step 
1410). Once the object player begins buffering the media 
stream, the media type and image size are determined from 
the media icon data source object (step 1412). If the media 
object image size is greater than the image display window 
default size, then the user is asked if he or she wishes to 
expand the image display (step 1414). If the tiser agrees, or 
if the image size is smaller than the image display window 
default size, then the image display is resized to fit the actual 
image size of the media object (step 1416). Otherwise, the 
image display is left at the image display window default 
size (step 1418). Next, if the image display is located at the 
home position (as determined in step 1420) then it is 
centered (step 1422). Otherwise, the image display is not 
moved (step 1424). 

Once the object player buffers the media stream, the 
media object starts playing (step 1430), When this occurs, 
the checkbox 54 associated with the media object is 
imchecked by changing the corresponding check field in the 
sequencer DSO (step 1432). Changing the sequencer DSO 
causes the bound DHTML checkbox to be unchecked (step 
1434). When play ends (step 1440), the sequencer finds the 
next checked checkbox in the play list 50 (step 1442). The 
media icon associated with this media object is highlighted 
(step 1444), the URL of the new media object is loaded (step 
1446) and the new media object is played (step 1448) 
thereby returning to step 1402. If the sequencer cannot 
locate another checked checkbox in the play list 50, the 
object player stops (step 1450) and the site-driven area 18 
returns to default banner rotation (step 1452). 

As shown in FIG. 15, if the user clicks on the banner 122, 
a copy of the banner is moved into the top layer DHTML so 
that the banner can be dragged (step 1502). If the last button 
is released when the banner is touching the image display 80 
(as determined in step 1504) or if the banner is touching the 
sequencer play list box 44 (as determined in step 1506), the 
URL of the media object associated with the banner is 
retrieved from the sequencer DSO current record (step 
1508). If the mouse is released elsewhere, then the banner 
will disappear (step 1510). If the banner was moved to 
contact the sequencer, a new record is created in the 
sequencer DSO (step 1520). Identification codes for the user 
and tabs are copied into the new record (step 1522) and the 
banner media object data is also copied into the new record 
(step 1524). Finally, the DHTML play list table is updated 
with the new sequencer DSO record (step 1526). 

On the other hand, if the banner is moved to contact the 
image display window 80, then the object player 16 is 50 
paused (step 1530). If the banner is moved away from the 
image display window 80 without releasing the mouse 
button (as determined in step 1532), then the object player 
16 resumes playing (step 1534) and the banner may continue 
to be dragged around the screen. However, if the mouse 
button is released when the banner is touching the image 
display, then the current media icon 52 in the play list 50 is 
highlighted in red to indicate that it has been interrupted 
(step 1540), and the media object associated with the banner 
is played (step 1542). When the media object associated 
with the banner has stopped playing, the current media icon 
52 is changed back to a yellow highlighting (step 1544 ) and 
play is restarted (step 1546). 

As shown in FIG. 16, when the user clicks on indicator 
130 (step 1600) or button 56, a sponsor or source pop-up 
string is retrieved from the sequencer DSO current record 
(step 1602). The string is an encoded "menu description 
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notation" (MDN) string that describes the hierarchy of menu 
items, the appearance of the menu and the programmed 
behavior for the menu items. Specifically, the string is an 
ordered sequence of delimited fields. The MDN string is an 
economical means to transport the instructions for building 
and defining the content of pop-up menus from the server to 
the client or between client feature datastores. Each menu 
item includes the following fields: 



Caption 
Command 



Trigger 



Status 



Image 
Separator 



Hic text to be written in the menu item 

a code representing a predefined command to be executed by 

the web page 

Parameters for the command. Multiple parameters may be 
delimited fay a tilde character 

Identifies the type of mouse event that triggers the command, 
such as "Rollovef or "Click" 

Indicates how a menu items should be dLsplayed if the 
command is not available, e.g., dimmed, grey text, or 
removed. 

The URL for a graphic to appear in the menu item 
A horizontal relief line. 



Each field may be delimited by a character, such as the 
"caret" character and menu items may be delimited by 
a "bar** character "|", In addition, two control characters are 
used to define the hierarchical relationship between the 
menu items. Specifically, one control character, e.g., a 
"greater-than" character indicates a step to a super- 
menu of the cunent menu item, whereas the other control 
character, e.g., a "less-than" character "<", indicates a step 
to a sub-menu of the current menu item. The MDN handles 
null data fields and truncated strings by assuming a default 
behavior. 

For example, the pop -up menu 56 shown in FIG. 17 may 
be generated by the following MDN string: 

<|Preview"'^"" D**|<|ViewT"http://205. 180.55.240/ 
dataplus/foxsearchlightS 23/server/docs/filmstrips/ 
re almedia/1 024/63 .jpg-^^R"*! >| D escrip tion"| <|Re ad' 
D*--- j^^^l^AAAAAAA truc^lluf o^'^^'^D <| Titlc ^ ^ 
D^^l <|Ed Burns-'^N^R''*|>|Author"'^"'^D'^^ 
|<|Fox Searchlight""*N*R**|> I Copy right 
AAAA D^-^i <pN^R--|>|Modify Date^^^^ D^1<|6/l9/97 
9:30:50 AM"''N'^R^^|>|Details""'^"D*^|<|Image 
Size'^'^'^^D^']<|112 Heightxl60 Width"'N^R"|>|Media 
Typ^A^AA D"|<|Video'^'^N'^D'^>|Frame Rate'^^'^'^D"|<|10 
fps^**N^R*^|>|Duration'^'^'^^D"^|<|20**^N"R*^|>|> 
|22 |Source'^'^^'^D"*|<|Name'^'^'^'^D"'^|<|Fox 
Searchlight Pictures**"N"R*''|>|URL'''^ " 
D""|<|www.foxsearchlight.com''^^* R""|<|Open "U'http:// 
www.foxsearchlight.com//index,htm-""R**|>|>|> 
|Sponsor^|<|Name''^'^'^ D"|<|Inter"N*R*>| URL'^'^'^'^D' 
^|<|intel.com'^'^'^^R'"|<|Open'^U"override~'^N^D"|>|>|Play 
-V*_--N^D^>|Buy'^^'^'^ D^|<|Tape^^'^'^D"|<|$14.95'^^'^'^ 
D""|<|PurchaseNow"B^override-"N'^R"|>|>|DVD'''^'''' 
D"^|<|""""R*^|<|-*N^R^^|>|>Stream"'^'^" 
D"1<|$.50^'^'^'^R^^<|Purchase Now"B^override-'*N"R"| 
When the MDN string has been retrieved from the 
sequencer DSO, a message can be displayed to the user 
indicating that the pop -up menu is being built (step 1604). 
The MDN string is passed to a pop-up engine (step 1606). 
The pop -up engine constructs a multidimensional array. This 
array can be interpreted by a pop-up menu builder to 
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construct an HTML pop -up array. The pop-up engine parses 
each string section (step 1610) by searching for the menu 
item delimiter. If the deUmited string contains a down- 
control character, the pop-up engine tests for the existence of 
a lower menu level (step 1614). If the lower menu already 5 
exits, then it is selected (step 1616). Otherwise a new menu 
level is built (step 1618). Similarly, if the up control char- 
acter is found, then a pop-up engine tests for existence of a 
higher menu level (step 1624). If the higher menu level 
already exists, then that menu level is selected (step 1626), 
Otherwise, a new menu level is built (step 1628). If the 
delimited string contains neither an up nor a down control 
character, then the data in the string is parsed (step 1632). 
When the pop-up engine has reached the end of the string 
(step 1634), the array is passed to the pop -up menu builder 
which constructs an HTML menu from the array and writes 
the new HTML to the document. 

When the mail feature is activated, the user's ID and an 
identification of the currently selected play list are written to 
an electronic mail table record in the user database. A 
window is opened to present a standard ASP form to receive 20 
information about the recipient, e.g., the recipient's elec- 
tronic mail address. When the electronic mail is sent, the 
fields from the ASP form are inserted into the electronic mail 
table record, the body of the electronic mail is written, and 
the mail is formatted with a New Mail Active Messaging 25 
Component and passed to an NT SMTP service. The NT 
SMTP service connects to a remote domain mail server 
account, and passes the outbound mail for delivery. When 
the recipient selects the delivered electronic mail, the dis- 
played text will include a button linking to a mail query ASP 3Q 
form on the server. When the button is selected, a browser 
is launched and cormects to the server. The server deter- 
mines the browser configuration to see if it is capable of 
playing the media objects in the play fist and and capable of 
creating and operating a sequential player. If the browser is 35 
capable of playing the media objects, an HTML page is 
assembled appropriate to the browser configuration to dis- 
play the media icons from the mailed play list. However, the 
server may be configured to return a play list that includes 
only the currently vaUd media objects so that when the 4Q 
recipient chooses to play the media objects, bad links will be 
avoided. The electronic mail recipient may then play the 
media objects. 

The invention has been described in terms of a particular 
embodiment. Other embodiments are within the scope of the 45 
following claims. For example, although the application has 
discussed web pages that are accessed though the Intemet, 
the invention is generally applicable to other client-server 
arrangements, such as an Intranet, where the client runs a 
viewer program and the server delivers an electronic docu- 
ment the client. 

What is claimed is: 

1. A web page, comprising: 

a player displayed in a first region of a web page for 
playing media objects; 55 

a sequencer displayed in a non-overlapping second region 
of the web page which displays a play list that defines 
an order in which one or more media objects are played 
by the player; and 

a media access area displayed in a non-overlapping third 60 
region of the web page, wherein the media access area 
contains a plurality of graphical icons, each graphical 
icon representing a media object sourcing streaming 
content, wherein the graphical icons can be manipu- 
lated by a user to modify the play list, and wherein the 65 
media access area and sequencer are displayed simul- 
taneously in the second and third regions. 
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2. The web page of claim 1, wherein the graphical icon 
includes an indication of a media type of the media object. 

3. The web page of claim 2, wherein the graphical icon 
further includes text describing content of the media object. 

4. The web page of claim 1, wherein one or more of the 
graphical icons can be dragged from the media access area 
to the sequencer to add the media object represented by the 
graphical icon to the play list. 

5. The web page of claim 1, wherein the sequencer can 
display one of multiple play lists. 

6. The web page of claim 5, wherein the sequencer 
includes a tab for each play list, and the user can select one 
of the tabs to switch between the play lists, 

7. The web page of claim 1, wherein the sequencer 
includes a play list box containing copies of the graphical 
icons representing each media object in the play list. 

8. The web page of claim 7, wherein the sequencer 
includes a checkbox for each graphical icon in the play fist, 
the checkbox controlling whether the player will play the 
graphical icon. 

9. The web page of claim 7, wherein the sequencer 
includes a pop -up menu for each graphical icon in the play 
list, each pop-up menu providing information about the 
media object. 

10. The web page of claim 1, wherein the sequencer and 
media access area are implemented with scripted DHTML. 

11. The web page of claim 1, wherein the media access 
area includes an outline of subjects and the graphical icons 
are arranged in fists in the outline. 

12. The web page of claim 11, wherein at least one level 
of the outline is expandable and collapsible. 

13. Hie web page of claim U, wherein the media access 
area includes a tab for each sutjject at a top level of the 
outfine, and the user can switch between the subjects by 
selecting one of the tabs. 

14. The web page of claim 11, wherein the media access 
area displays one of a plurafity of outlines. 

15. The web page of claim 14, wherein the media access 
area includes a tab for each outline, and the user can switch 
between the outlines by selecting one of the tabs. 

16. The web page of claim 1, wherein the player includes 
a control panel and an image display window. 

17. The web page of claim 16, wherein the image display 
window can be dragged across the web page. 

18. The web page of claim 17, wherein the image display 
window includes a home button to return the image display 
window to a home position on the web page. 

19. The web page of claim 16, wherein the image display 
window includes an image area and a handle, and the handle 
includes a button to hide the image area. 

20. The web page of claim 16, wherein the image display 
window includes a size lock button to prevent the image 
display window from expanding beyond a default size. 

21. The web page of claim 1, further comprising a 
site-driven area to display a banner. 

22. The web page of claim 21, wherein the banner is 
synchronized with the media object being played by the 
player. 

23. The web page of claim 21, further comprising a 
banner media object associated with the banner 

24. The web page of claim 23, wherein the user can 
change the play list to play the banner media object by 
manipulating the banner. 

25. The web page of claim 24, wherein the user can drag 
the banner to the sequencer to add the banner media object 
to the play list. 

26. The web page of claim 24, wherein the user can drag 
the banner to an image area of the player to play the banner 
media object. 
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27. The web page of claim 23, wherein the banner 
includes a pop -up menu to display information about the 
banner media object. 

28. A method of operating a web page, comprising: 
displaying multiple sources of streaming content to a user ^ 

in a first area of a web page; 
receiving user input to select a playing order for the 
sources of streaming content; storing the playing order; 
and displaying the playing order in a second area of the 
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web page, wherein the multiple sources of streaming 
content and the playing order are simultaneously view- 
able in non-overlapping first and second areas; 

receiving user input to start delivering the streaming 
content to the user; and 

presenting the streaming content to the user in the stored 
playing order in a third area of the web page. 

***** 
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